
PARALLEL SCANNED LASER CONFOCAL MICROSCOPE 

This invention was made with U.S. Government support under Grant No. DMR- 
9730189 awarded by the National Science Foundation and through the MRSEC Program of the 
National Science Foundation under Grant Number DMR-9880595. 

The present invention is directed generally to a method and apparatus for creating 
three-dimensional images of samples using principles of scanned laser confocal microscopy. 
More particularly, the invention is directed to a method and apparatus for the use of multiple 
scanned laser beams operating in parallel and in conjunction with a spatially-resolved area 
p detector to receive the optical images created by each of the plurality of beams. This method 
$ and apparatus retains all of the advantages of conventional scanned laser confocal microscopy 

with the substantial additional advantages of (1) greatly increased acquisition speed, (2) the 
lf\ longest possible exposure times for samples which produce low-light-level images, (3) compact 

8 

(3 design, (4) no moving parts, and (5) the feature of integrated optical trapping with no 

St 

['! additional components. 

d 

It is known that confocal microscopy can be applied using a tightly focused beam of 
light to illuminate a sample. The illumination is most intense at the focal point, so that the 
volume of the sample located at the focal point has more opportunity to scatter the incident 
light than any other region of the sample. The light detection system in a confocal microscope 
also is focused onto the same volume of the sample as the illumination system. Light scattered 
by the sample from this volume thus is preferentially detected relative to light scattered by 
other regions of the sample. The detection system's selectivity for light scattered within the 
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illuminated volume typically is enhanced by the addition of one or more apertures which block 
light emanating from other regions of the sample. 

The combination of selective illumination with a focused light source and selective 
detection with an optical system focused onto the same sample volume (confocal detection) 
provide a conventional confocal microscope with several capabilities. The confocal detection 
system's ability to reject light scattered from other regions of the sample makes possible 
imaging in relatively turbid samples. Confocal imaging with high numerical aperture optics 
also makes possible imaging with very small depth of focus. Confocal microscopes thus can 
focus deep into samples and create well-resolved optical slices through a three-dimensional 
sample with minimal cross-talk or convolution of images between slices. These optical slices 
then can be combined to create a three-dimensional representation of the sample. 

The principal practical considerations for establishing confocal microscopy are (1) to 
scan the focused illumination through the sample in a desired pattern and (2) to maintain 
confocal detection by keeping the focal volume aligned with the illumination volume. A 
typical conventional implementation of laser scanning confocal microscopy 128 is shown in 
FIG. 1. A collimated laser beam 100 passes through a beam splitter 110 before being deflected 
by a gimbal-mounted mirror 114, or equivalent beam steering device. This beam is directed 
into the back aperture of the microscope's objective lens 125 through a relay lens consisting of 
lenses 115 and 116 and beam splitter 120. Typically, an objective lens 125 and the beam 
splitter 120 are included in the body of the conventional optical microscope 128 and the 
additional components are mounted outside the microscope's body as a separate assembly. The 
laser beam 100 is focused to a point 140 by the objective lens 125 to illuminate a sample 142, 


# 


and 144 light is scattered by the sample 142, and light 144 radiates in all directions. Some 
fraction of this scattered light 144 falls within the acceptance solid angle of the objective lens 
125 and travels backwards down the beam line followed by the illumination light 100. This 


fraction is labeled 101 in FIG. 1 and is shown superimposed on the illuminating beam 100. 
The returned beam 101 emanates from the focal point 140 of the objective lens and so is 
collimated by the objective lens. Light originating from other sources (not shown in FIG. 1) is 
not collimated by the objective lens. In practice, both the illuminating 100 and returned 101 
beams would fill the entire aperture of the optical train. The returned beam 101 is reflected by 
the gimbal mounted mirror 1 14 back along the path taken by the illuminating laser 100 and 

□ 

$ then reflected again by beam splitter 110. The collimated returned beam passes through 

*3 

u 

V j aperture 118 and is detected by photodetector 119. Rays of light emanating from a source not 
UJ 

jfc located at the focus 140 would not pass through aperture 118 and so would not be detected. 

ch 

£9 Tilting the gimbal-mounted mirror 114 deflects the illuminating beam 100 and so 

M 

^ translates the focal spot 140 across the microscope's field of view. Because the returned beam 

n 

p 101 follows the same optical path as the illuminating beam, up to the beam splitter 110, the 
detection system is confocal with the illumination system. Scanning the focal spot 140 across 
the field of view with the gimbal-mounted mirror 114 and correlating the signal measured with 
the photodetector 119 with the mirror's deflection angle yields a two-dimensional optical slice 
through the sample 142. 


The beam splitters 1 10 can be selected to optimize illumination and detection 
efficiency. If the returned beam has the same wavelength as the illumination beam, efficiency 
could be improved by using a polarization selective form of the beam splitter 1 10 and adding 
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polarization-rotating components in the beam line. If the returned beam has a different 
wavelength because it results from fluorescence, for example, then selection could be based on 
wavelength, using a dichroic form of the beam splitter 110. 


The rate at which such an optical slice can be obtained is limited by the rate at which 

the beam can be deflected by mirror 114. A mechanical deflector, such as a gimbal-mounted 

form of the mirror 114, offers a relatively slow deflection rate, with a bandwidth typically well 

below 1 kHz. Acousto-optical and electro-optical deflectors offer much higher band widths but 

introduce aberrations into both the illuminating and returned beams whose severity varies with 

W the deflection angle. Increasing the deflection rate to increase the imaging rate has the 

^ undesirable consequence of reducing the length of time that the illuminating beam is focused on 

y any particular region of the sample. Imaging weakly scattering samples therefore, is hampered 
& 

£h by low light levels (and thus low contrast) at the detector 119. A number of disadvantages 

9 

jj'jj therefore exist for a conventional single beam confocal microscopy system. 
[U 

p SUMMARY OF THE INVENTION 

Parallel laser scanning confocal microscopy uses a plurality of laser beams to scan 
through a sample simultaneously, and a pixellated area detector is preferably used to detect 
separately the light scattered by each of the plural laser beams. Scanning a plurality of laser 
beams through the sample simultaneously provides several advantages over conventional 
single-beam scanning laser confocal microscopy. For equal scanning rates, parallel scanning 
reduces the total data acquisition time for one slice by a factor equal to the number of beams. 
This can be useful for high-speed imaging of moving samples. Further improvements in 
simultaneous imaging accrue from having many beams probe many regions of the sample 
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simultaneously. Single-beam systems, by contrast, expose one volume element at a time, so 
that the last volume element is imaged one entire scan period after the first volume element. 

For equal acquisition times, parallel scanning increases the illumination period for each 
volume of the sample by a factor equal to the number of beams. This can be extremely useful 
for weakly-scattering samples by permitting much longer exposure times without increasing the 
time to acquire a complete image. Furthermore, delicate samples can be imaged in 
proportionately lower light levels, thereby reducing the possibility of damage by laser 
irradiation. 

Other important advantages are that parallel laser scanning confocal microscopy can be 
implemented with fewer optical components and without moving parts. The simplified optical 
train can be aligned simply and precise alignment can be obtained automatically under software 
control, thereby relaxing the specifications on alignment and alignment stability during 
manufacturing. 

It is therefore an object of the invention to provide an improved method and system for 
confocal microscopy. 

It is another object of the invention to provide an improved method and system for 
plural beam laser scanning microscopy. 

It is a further object of the invention to provide an improved method and system for 
parallel laser beam scanning confocal microscopy. 
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It is an additional object to provide an improved method and system for plural laser 
beam scanning of weakly scattering and light sensitive samples for enhanced image formation 
without sample damage. 

Other objects, advantages and features of the present invention will be readily apparent 
from the following description of the preferred embodiments taken in conjunction with the 
accompanying drawings described hereinafter. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 illustrates a conventional laser scanned confocal microscopy system; 

Q FIG. 2 illustrates one embodiment of a confocal microscopy system of the 

tQ invention; 

\li 

& FIG. 3 illustrates optical system rejection characteristic of the system of FIG. 2; and 

M 

W FIG. 4 illustrates another embodiment of a confocal microscopy system of the 

invention. 

In 

s 

5 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

ni 

p One embodiment of a parallel laser scanning confocal microscope is shown generally at 

200 in FIG. 2. A collimated laser beam 202 is incident on a diffractive medium, such as a 
diffractive beam splitter 204 which divides the beam 202 into N separate collimated beams, 
only one beam 208 of which is shown in FIG. 2 for clarity. Each of the diffracted beams 208 
emanates from the diffractive beam splitter 204 at a distinct direction denoted by the solid 
angle Q. The number AT of the beams 208, their relative intensities, and their angular 
configuration Q, all are most preferably determined by a computer-generated hologram 
encoded in the diffractive beam splitter 204. This diffractive beam splitter 204 can be 
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implemented with a variety of media including addressable liquid crystal phase shifting arrays, 
microelectromechanical (MEMS) micromirror arrays, or diffractive optical elements encoded 
in the surface relief or dielectric constant of otherwise transparent substrates, or encoded in the 
surface of reflective surfaces. Such systems are represented as 400 in FIG. 2. 



\^ \^ \Each of the diffracted beams 208 is transferred by a relay lens system, one embodiment 
of which\n c hKles a first lens 210 and a second lens 212, also shown in FIG. 2. The lenses 


210 and 212, or equivateftt-optical elements, are arranged so that a collimated beam of light, 
such as 208, emerging from me centenof the diffractive beam splitter 204 also passes as a 
collimated beam^OS through tne center of the entrance pupil of focusing element 214. In a 


14 


01 


ru 
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preferred embodiment, ihis focusing element 214 consists of a high-numerical aperture 
objective lens. In the\implementation depicted in FIG. 2, the beams 208 are reflected into the 
back aperture of the focusing element 214 by a beam splitter 204 whose reflective properties 
are chosen to direct the illuminating laser light towards the focusing element. Each collimated 
one of the beams 208 enters uie back aperture of the objective lens (the focusing element 214) 
at a distinct angle which is proportional to the angle Q, which is established by the diffractive 
beam splitter 204. Thus, each oftthe beams 208 comes to a separate focus in the focal plane of 
the objective lens 214 at a displacement from the center of the field of view proportional to Q. 
By controlling the number N and direction Q of the beams 208 created from the collimated 
laser beam 202, the diffractive beam splitter 204 controls the pattern and location of focused 
spots of laser light in its object plane. Th\ particular focal spot for the beam 208 is indicated 
at 224 in FIG. 2. 
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Some of the light from the beam 208 focused at a focal point 224 will be scattered by 
sample 216 at that focal point 224. This light component emanates as if from a point source in 
the focal plane of the objective lens 214 and will be collimated thereby, returning down the 
optical path initially taken by the illuminating collimated beam 208. Rather than allowing this 
returned light to travel all the way down the illumination path, as shown in the prior art system 
of FIG. 1, the second beam splitter 218 allows a returned beam 220 to pass through to the 
microscope's imaging optics, represented schematically by an ocular lens 222 in FIG. 2. The 
returned beam 220 is shown superimposed on the collimated beam 208 for clarity. In practice, 
both the beams 208 and 220 would fill the aperture of the objective lens 214. 

0 

^ Each of the collimated beams 208 created by the diffractive beam splitter 204 

y illuminates a separate volume of the sample 216 and thus results in a separate returned beam, 

f» 

(n such as the returned beam 220 resulting from one of the collimated beams 208. The intensity 

a 

P of each of these returned beams 220 depends on the efficiency with which each region of the 

HI 

: 3 sample 216 scatters laser light. Each of the returned beams 220 is brought to a separate focus 

o 

by the ocular lens 222, with only the particular focus for the returned beam 220 being shown 
in FIG. 2 for clarity, with the focal point being indicated at 224. 

The individually focused beams of light from the returned beams 220 can be detected 

simultaneously with a pixellated area detector 226, such as a charge-coupled device (CCD) 

camera or other numerous conventional area sensor technologies available to detect light at 

selected locations. These technologies include but are not limited to photodetector arrays, 

microchannel plates, and complementary metal-oxide-semiconductor (CMOS) detectors. The 

location f , of one of the particular returned beams 220 on the detector 226 depends on the 
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direction Q at which the collimated beam 208 was created by the diffractive beam splitter 204. 
The angular range Q can be selected so that f coincides with one of the pixels on the area 
detector 226 for each of the N illuminating collimated beams 208. This alignment can be 
obtained by calculating approximately the phase shifting pattern projected by the beam splitter 
204 and can be considered as virtual alignment. Virtual alignment can be obtained under 
software control by imaging a uniformly reflective surface and calculating holograms which 
project spots centered on pixels located in the area detector 226. 

If the computer-generated diffractive beam splitter 204 is implemented in the form of an 
addressable device, such as a spatial light modulator, then the beam configuration can be 
updated with a new pattern, thereby addressing a new set of sample volumes whose images 
will be projected onto a new set of pixels on the area detector 226. In this way, one optical 
slice of the sample 216 can be scanned by updating the diffractive beam splitter 204 with a 
sequence of complementary patterns. 

Furthermore, the embodiment of the invention in FIG. 2 indicates that beam splitter 
204 operates in a transmission mode. The same basic scheme will operate also with a 
reflective diffractive form of the beam splitter 204, with appropriate modifications being made 
in the optical train. One form of this embodiment will be described hereinafter as shown in 
FIG. 4 as one example of the reflective mode of operation. 

Another advantage of the microscope 200 as depicted in FIG. 2 is the lack of any 
apertures, unlike the prior art design in FIG. 1. Although there are no apertures, the 
microscope 200 still achieves excellent confocal imaging. Consider a region of the sample 216 


near, but not at the confocally illuminated volume disposed about the focal point 224 in FIG. 
2. An example of such a location is denoted as region 228 in FIG. 3. Some of the light 
scattered by this region 228 will be collected by the objective lens 214. However, because this 
source of light (the region 228) does not lie in the objective's focal plane, the returned light 
230 is not collimated. Rather than being brought to a focus by the ocular lens 222 onto the 
area detector 226, the returned light 230 is defocused. This diffuse scattering pattern, labeled 
as zone 232 in FIG. 3, delivers much less light to the pixel at f than would an equivalent 
element of the sample 216 at the confocal focal point 224. This intensity reduction comes from 
two sources. In the first case, the illumination is far less intense away from any of the 
confocal points, than it is at the confocal focal point 224. Thus, there is less light to scatter at 
non-confocal points. In fact, the sources of detectable image light must come from the 
intensely illuminated regions near the confocal points. The returned fraction of the non- 
confocal scattering then is further reduced in intensity by being spread across several detector 
pixels of the area detector 226 other than the confocally illuminated pixel at position f . 

Each confocally illuminated pixel of the area detector 226 therefore is surrounded by a 
"zone of confusion" (the zone 232) of approximate radius 8 within which non-confocal regions 
of the sample 216 contribute to the detected signal. This light would be filtered out in a 
standard confocal optical train such as in the prior art embodiment of FIG. 1 by an aperture 
118. This light can be rejected in the microscope 200 by ignoring the data generated by pixels 
in the zone 232 around each confocally illuminated pixel of the area detector 226. Rejecting 
signals from non-confocally-illuminated pixels performs the task normally performed by an 
aperture 118 and thus can be functionally considered a virtual or synthetic aperture. 

10 


If the beam splitter 204 of FIG. 2 produces the collimated beams 208 whose images 
were closer than 8 on the area detector 226, then non-confocal scattering from each would be 
detected by the others, thereby degrading performance. The pattern of the beams 208 created 
by the beam splitter 204 therefore is most preferably chosen so that no two images are closer 
than 5 at the area detector 226. Minimizing crosstalk between simultaneously illuminated 
pixels of the area detector 226 in this manner sets the maximum number N of spots which can 
be used to illuminate the sample 216 in any configuration. If the area detector 226 has M 

2 

pixels, then TV « M I (45 ). 


* f j It should be noted that the confocal microscope 200 can also be adapted to function in 

i 

fa an optical tweezer mode. This additional use can be accomplished by increasing the intensity 

Nl 

Ml of light to one of the illuminating collimated beams 208 enabling function as an optical 
^ tweezer. Varying the intensity of one or more beams relative to the others can be 

s 

o 

fc.'j accomplished by computing and projecting an appropriate diffraction pattern in which the 

fU 

%| desired trapping beams receive a greater proportion of the light available in the beam 202. 
C3 

K This operation can be performed in tandem with varying the power of the laser beam 202 so as 
to maintain constant imaging intensity during trapping. This optical tweezer mode of the 
microscope 200 also could operate to provide a converging or diverging light beam 208 which 
would be brought to a focus on form an optical trap out of the focal plane of the objective lens 
214, provided an appropriate hologram were computed, and thus the light scattered by the 
trapped portion of the sample need not be detected by the confocal detection scheme, unless so 
desired. 
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\^ \n yet another example form of the invention shown in FIG. 4 a parallel scanned 

confocal Ynicroscopy system 300 employs a reflection-mode spatial light modulator 302. A 

beam of light 304 is incident on the face of the spatial light modulator 302 (hereinafter SLM 

302). The s\.M 302 encodes a phase modulation on the beam of light 304 suitable for splitting 

the beam of li&it 304 into several independent beams, only one of which 304 is shown for 

clarity. Each of\he be^fns of light 304 is directed by the same phase pattern into a distinct 

direction, with the^iejficted collinfeted beam 30^ being directed at solid angle Q away from an 

optical axis 306. Eaty\ of the collimkted-be^ms 304 created and directed by the phase pattern 

of the SLM 302 is trari$f£rrda to the back aperture of the objective lens 214 (or other suitable 

focusing optical elemendto create the diffraction limited focal point 224. In FIG. 1 the 

collimated beams 304 are transferred with two lenses 308 and 310 arranged to create a plane 

■P conjugate to the objective's Back aperture at the center of the SLM 302. The optical axis 306 
tfl 


is thus established so that a beam of light passing from the SLM 302 along the optical axis 306 


□ 

fy will pass through the center of the objective's back aperture and come to a focus in the middle 
M 

Q of the objective's focal plane. A ftf am such as the collimated beam 304 traveling at an angle 
of Q with respect to this optical axis\306 passes through the middle of the back aperture at an 
angle and thus forms the focal point 2^4 away from the center of the focal plane. The beam 
splitter 218 serves to direct the collimated beams 304 into the aperture of the objective lens 
214. 

Any material at the focal point 224 can scatter some of the incident light out of the 
focal point 224. Some of this scattered light can be collected by the objective lens 214 to form 
a returned beam 220 The second beam splitter 218 can be selected to transfer some or all of 
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this returned beam 220 to the imaging microscopy system 300 and the area detector 226. Light 
emanating from the focal point 224 is focused by the ocular lens 222 into a spot on the area 
detector 226 centered at position 312. This position 312, in turn, depends on the angle Q that 
the illuminating collimated beam 304 makes with the optical axis 306. This, in turn depends 
on the phase pattern encoded in the SLM 302. 

In regard to resolution of positioning the collimated beam of light 304, a typical form of 
the SLM 302, has a square or rectangular array of phase-shifting pixels, each of which 
typically covers a square or rectangular region of the SLM's active aperture. If the SLM 302 
P has N pixels in one dimension, and each pixel can implement p levels of phase shift, ranging 
p between 0 and 2n radians, then the SLM 302 can steer a bean into 2Np directions along that 
[ij dimension. The actual angular deflection depends on the separation between pixels a and the 
CO wavelength of light X , with the increment between angular deflections being X l{Npa) in the 

a 

paraxial approximation. The same result obtains for the SLM 302 or diffractive beam splitter 

ru 

\j 204 operating in reflective or transmissive mode. 

P 

M The resolution with which the collimated beams 304 directed by the SLM 302 can be 

positioned on the area detector 226 depends on the magnification of the microscopy system 
300, shown schematically as the simple ocular lens 222 in FIG. 4, and on the number M of 
detector pixels in a given dimension. The optimal magnification matches the scan range 
obtained from the SLM 302 with the active area of the area detector 226. In this condition, an 
individual one of the collimated beams 304 can be placed to within M I (Np) of the center of an 
imaging pixel. Alignment accuracy approaching 1/10 pixel therefore can be obtained over a 
typical 512 x 512 imaging area using commercially available ones of the SLM 302. 
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While preferred embodiments of the invention have been shown and described, it will 
be clear to those skilled in the art that various changes and modifications can be made without 
departing from the invention in its broader aspects as set forth in the claims provided 
hereinafter. 
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